Conversation
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Merging this PR will degrade performance by 20.14%
Performance Changes
Comparing Footnotes
|
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Polar Signals Profiling ResultsLatest Run
Previous Runs (1)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 0.982x ➖ datafusion / vortex-file-compressed (0.982x ➖, 1↑ 0↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.947x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.969x ➖, 0↑ 0↓)
datafusion / parquet (0.975x ➖, 2↑ 2↓)
datafusion / arrow (0.951x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (0.969x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.966x ➖, 0↑ 0↓)
duckdb / parquet (0.997x ➖, 3↑ 3↓)
duckdb / duckdb (0.968x ➖, 2↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.023x ➖, 0↑ 1↓)
datafusion / vortex-compact (0.927x ➖, 3↑ 0↓)
datafusion / parquet (0.976x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.982x ➖, 0↑ 0↓)
duckdb / parquet (0.985x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.703x ➖, 12↑ 0↓)
datafusion / vortex-compact (0.915x ➖, 2↑ 2↓)
datafusion / parquet (0.891x ➖, 5↑ 2↓)
duckdb / vortex-file-compressed (0.878x ➖, 2↑ 0↓)
duckdb / vortex-compact (0.923x ➖, 0↑ 0↓)
duckdb / parquet (0.926x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.923x ➖, 3↑ 0↓)
datafusion / vortex-compact (0.920x ➖, 5↑ 0↓)
datafusion / parquet (0.939x ➖, 2↑ 0↓)
datafusion / arrow (0.909x ➖, 7↑ 0↓)
duckdb / vortex-file-compressed (0.915x ➖, 6↑ 0↓)
duckdb / vortex-compact (0.933x ➖, 1↑ 0↓)
duckdb / parquet (0.965x ➖, 0↑ 0↓)
duckdb / duckdb (0.960x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.049x ➖, 0↑ 10↓)
datafusion / vortex-compact (1.055x ➖, 0↑ 8↓)
datafusion / parquet (1.034x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (1.025x ➖, 0↑ 3↓)
duckdb / vortex-compact (1.032x ➖, 1↑ 5↓)
duckdb / parquet (1.046x ➖, 0↑ 11↓)
duckdb / duckdb (1.045x ➖, 0↑ 10↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.881x ➖, 2↑ 0↓)
datafusion / vortex-compact (1.004x ➖, 0↑ 1↓)
datafusion / parquet (0.901x ➖, 1↑ 1↓)
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.050x ➖, 0↑ 2↓)
duckdb / parquet (0.986x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.821x ✅ unknown / unknown (0.927x ➖, 14↑ 1↓)
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.006x ➖, 0↑ 1↓)
duckdb / parquet (0.970x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
datafusion / parquet (1.053x ➖, 0↑ 7↓)
duckdb / vortex-file-compressed (1.019x ➖, 1↑ 1↓)
duckdb / parquet (1.017x ➖, 0↑ 0↓)
duckdb / duckdb (0.974x ➖, 1↑ 0↓)
Full attributed analysis
|
File Sizes: Clickbench on NVME
Totals:
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.922x ➖, 4↑ 4↓)
datafusion / vortex-compact (0.917x ➖, 5↑ 2↓)
datafusion / parquet (1.128x ➖, 0↑ 7↓)
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
duckdb / vortex-compact (1.036x ➖, 0↑ 1↓)
duckdb / parquet (1.049x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 1.008x ➖ unknown / unknown (0.980x ➖, 11↑ 1↓)
|
|
This likely broke:
|
|
Ill work on the fix |
After #7287 The validity of some arrays as in-corrected cached. This PR fixes that. --------- Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
This PR continues the Array VTables refactor by hoisting the common "slots" field out of ArrayData structs and into the generic Array struct.
Part of #6544
Closes #7240